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Virtual Texturing 


Extremely Large 
Virtual Texture 



Indirection 

Texture 


Physical Texture Cache 


Virtual address -> Physical address 


• Virtual texturing in games 

• Mega-Textures 

• Procedural Virtual Textures 
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Mega-Textures 

• Developed by id Software for Rage {Waveren 2013) 

• Texture data is stored on disk and streamed to memory as 
required 

• Runtime determines the required tiles (pages) and requests them 
from disk 

• Tiles are loaded to a tile cache (physical texture cache) and the 



Procedural Virtual Textures 

• Used by DICE in Frostbite Engine for Battle Fields 
(Widmark 2012) 

• Splats terrain rendering into virtual textures at runtime 

• No highly compressed virtual textures from disk 

• Direct render into virtual texture for missing pages 

• Leverages frame-to-frame coherency to reduce terrain 
rendering cost 

• Powerful GPU optimization for terrain rendering 
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Far Cry 4 Terrain 

• Cross platform (PS4, Xboxl, PC, PS3, Xbox 360) 

• Large world: 10 x 10 KM 

• Far terra in (Vista terrain > 300 meters away): 

• Offline baked geometry and textures 

• Near terrain: 

• Rendered from height-map 

• 4 detail material layers blended with a mask texture 

• Road and decals add unique detail 

• Target resolution: 10 texels / cm 

• Could use virtual textures 
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For next gen platforms we want to add a massive number of procedurally placed decals 



A 



• Simple deferred decals would be too expensive in this quantity 

• So optimize by baking decals into a virtual texture at runtime 



Virtual texture 

512K X 512K 


Indirection texture 

2K X 2K 


Physical texture 

9K X 9K 


1 1 indirection texture mips 
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Indirection Texture Format 


• Entry coordinate (x, y): 

• Each entry represents one virtual page 

• Entry coordinate = Virtual page coordinate / virtual page size 


• Entry content format: 32 bit integer 


PageOffsetX : 8 I PageOfifsetY : 8 I Mip : 8 I Debug : 8 


• PageOffsetX = Physical page U Coordinate / physical page size 

• PageOffsetY = Physical page V Coordinate / physical page size 

• Mip: Mip-map level of this page 

• Debug: used for debugging only 

(for example saving a frame counter) 


Indirection texture 
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Motivation 

• With conventional virtual texturing 

• 512K X 512K Virtual Texture on 10 x 10 Km world 

I 

0.5 texel/cm 10 texel/cm 

resolution resolution 

I 

• Another technique is required. 
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Adaptive Virtual Textures (AVT) 

• Based on procedural virtual textures 

• The lOxlOKM world is divided into 64x64 meter sectors 

• Near terrain sectors: 

• Allocate virtual images in the virtual texture 

• Nearer sectors : larger virtual images 

• 64K X 64K (64K / 64 meter = 10 texels/cm) 

• Farther sectors : smaller virtual images 

• 32KX32K 

• 16KX16K 

• 

• IK X IK 
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Adaptive Virtual Textures (AVT) 

• Allocate virtual images inside the virtual texture for all close 
sectors 
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Visualize the allocation of virtual images 
for close sectors inside virtual texture 
Each colored square represents one 
virtual image for each nearby sector 


Camera frustum 
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Continue until all nearby sectors 
are allocated in the virtual 
texture gdc 2015 


Multiple sectors slightly further 

from camera 

16K X 16K virtual images 


2 sectors nearest the camera 
64K X 64K virtual images 


6 sectors further from camera 
32K X 32K virtual images 






Upscale V 
closer 
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Downscale virtual 
moves further 



image size when camera 









upscale a Virtual Image 

• Terrain material blending with additional decals 

• Already cached in our physical texture cache 


Shift and reuse them! 


GDC 2015 



For all pages that are from mip 1 to mip 10, copy entries of indirection 
texture from old image to new image while shifting up 1 mip 


Old virtual image: 32K x 32K 

Mip 0 


Mip 1 


Mip 2 


Mip 3 ... Mip 7 Mip 8 mip 9 mip 10 

□ a ■ 


New virtual image: 6-‘'K x 64K 

Mip 0 
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Mip 1 


Mip 2 


Mip 3 


Mip 3 ... Mip 
8 


mip 9 

□ 


mip 10 
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Upscale virtual image of sector 32K -> 64 K 

Update all mip 1 entries in indirection texture for new virtual image 





Indirection texture mip 0 


Virtual texture mip 0 with old image 


One entry content in this image: 
{ PageOffset = (3, 2), Mip = 0 } 


Physical texture 


Indirection texture mip 1 


Virtual texture mip 1 with new image 


{ PageOffset = (3, 2), Mip = 1 } 


Do it for all pages in mip 1 in new virtual image 



V_J V_- ^ V_/ J_ 


Update mip 2-10 pages in the similar way 


update mip 0 pages in indirection texture 

• Need to handle mip 0 pages 

• They haven't been rendered in the old image 
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update mip 0 pages 

• 4 mip 0 pages have 1 corresponding mip 1 page 

• Temporarily map to lower mip page 

• Images appear blurred in this frame 

• Will become sharper after correctly updated. 


Mip 0 



Virtual texture mip 1 



Indirection texture mip 1 


One entry content in this image: 
{ PageOffset = (5, 2), Mip = 1 } 


Physical texture 


Virtual texture mip 0 


Indirection texture mip 0 


Copy entry content to 4 corresponding mip 0 entries 
{ PageOffset = (5, 2), Mip = 1 } 


Do it for all pages in mip 0 in new virtual image 


Update mip 0 pages in indirection texture 

• Copy indirection texture entries content 


Indirection texture mip 0 



Do not shift down mip! 


{ PageOffset = (x, y), Mip = 1 } 


• Physical UV is calculated according to the mip in the entry 

Code snippet in terrain pixei shader 

scaie = (virtuai texture size / physicai texture size) >> mip 
bias = physicai page offset - virtuai page offset * scaie 
physicai uv = virtuai uv * scaie + bias 




Physicai page offset and mip are the entry content 
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Downscale a virtual image 




We allocate a smaller virtual image in the virtual texture and 
remove the old one 

> 32K X 32K 


• In this example, 64K x 64K 
Reverse the steps of upscaling virtual image 


Scale down its virtual 
image 64K x 64K -> 
32KX32K 4m 


* Sector becomes 
^ : further to camera 
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Reduce memory for virtual page id buffer 

• Strategy 

• Output page IDs and MIP levels 

• To a Read Write Buffer 

• During G-Buffer pass 

• Buffer format (32 bits) 


PagelD X : 12 

PagelD Y: 12 

Mip : 4 

Size : 4 


• PagelD XY = Virtual UV / Virtual Page Size 

• Size = log2 (Virtual Image Size) 

• Buffer size: 1/8 of resolution of MRTs 
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Limit per frame rendering cost 

• Caching virtual textures can be slow 

• Camera moves fast -> need to render a lot of pages 

• When driving a vehicle 

• Flying 
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Limit per frame rendering cost 

• Solution: Distributed rendering 

• Sort required pages by mip levels 

• low -> high 

• Distribute the rendering of pages into multiple 
frames 
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Generate massive number of decals 


• Artists want to generate many decals 
efficiently 

• Solution: Procedural content generator 

• Automatically attach decals to specified objects 

• Leaves, stones, roots under trees 

• Cracks, dirt on road 

• Much more... 
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• Procedurally generated decal : 






Attach to other procedurally generated content 
For example generate fallen leaves under trees 





Anisotropic Filtering 


• Support 8x anisotropic in Far Cry 4 

• Texels in neighbor pages are not adjacent in world 
space 

• This could cause color bleeding 

• Solution: Add 4 texels border to physical 
texture pages 

• Physical texture page: 264 x 264 

• Render page with 264 x 264 viewport 
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4 texels border 

• •• .*"V • ? 

' ■ • ‘ •* •* •■ V 

Enlarge viewport 264 x 


264 

■•■ - ■ ** 

, ^ 




1 . . ^ . 

9' •, ^ • ►, 

•, .' -. - . :* ■ . 

page content 

h * % - • ' 

* A " • , • . ‘ • 

. ® ! V t ^ ^ k. . ^ • 

• Physical texture page: 264 * 264 

• 4 t ^ -■ ’ • *•• 1 ■■ „.•• . . *, 1 

*;•■• .• */•■•• .t' '•• • • 

• Can support 8x anisotropic filtering 

. «•. •. V. - ..* s-'x:*!* •• • • 



GDC 2015 




Support tiilinear filtering 

• Only bilinear filtering 

• See seams where mip level is changing 

• Far Cry 4 Solution: software trilinear filtering 

• Fetch virtual textures twice with mip(x) and mip(x+l) 

• Calculate linear blending of fetched colors in shader 

• Other solution: hardware trilinear filtering 

• Create V4 size mip 1 cache 

• Render into mip 1 cache too 

• Hardware handle the blending between mips 

• 25% more cache memory 
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Bi-Linear 



Anisotropic 


Tri-Linear, 

Anisotropic 
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Rendering Performance 


Performance 

(PS4) 

CPU 

(rendering thread) 

GPU 

Static scene 
(Cache primed) 

0.2 ms 

Analyze PagelD buffer 

0.1 ms 

Write PagelD buffer 

Dynamic scene 
(Caching virtual 
textures) 

0.5 - 1 ms 

Setup time for render 

0.5 - 1 ms 

Render terrain and decals 
into virtual textures and 
compress to BC format 
textures 
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Memory Consumption 


Memory 

PagelD Buffer 

Indirection 

Texture 

Physical 

Texture 

Total 

Memory 

0.4 MB 

16 MB 

202 MB 

220 MB 
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Summary 

• Procedural virtual texture is a good fit for terrain 
rendering 

• Using AVT we can increase the resolution of the 
results 

• Great when drawing a massive number of decals 
on Far Cry 4 
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• Far Cry 4 rendering and arts team 

• GDC reviewer : Mark Cerny 
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Thanks! 
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